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ABSTRACT 



This paper examines in detail how higher education serves 



the larger public good, focusing on how higher education assesses and 
accounts for its service to society. It begins with a brief description of 
how the civic education of students and institutional service to society are 
defined for the purposes of this paper. It then discusses assessment and 
accountability strategies, including the kinds of measures that tend to be 
the focus of most public reporting strategies. The civic education and 
service roles of higher education are not usually the focus of public 
reporting. When civic contributions are assessed, something else, whether 
service learning, campus, climate, student diversity, or "service” to the 
community, is measured. To build assessments of the civic contributions of 
higher education into reports of accountability, there are some obstacles 
that must be overcome. This paper identifies those obstacles and presents 
some strategies to build assessment and accountability capacities for the 
civic roles of higher education. The strategies are drawn from assessment 
models currently being used to measure specific dimensions of campuses 1 civic 
roles and activities. An appendix lists 14 resources for further information. 
(Contains 21 references.) (SLD) 
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PREFACE 



This working paper is one in a series that has informed the work conducted as 
part of The Institute for Higher Education Policy's New Millennium Project on 
Higher Education Costs, Pricing, and Productivity. Sponsored by The Institute for 
Higher Education Policy, The Ford Foundation, and The Education Resources 
Institute (TERI), the project is a multi-year effort to improve understanding 
and facilitate reform of the complex system for financing higher education. 

The paper was prepared by Jane Wellman, with editorial support and guidance 
provided by Colleen O'Brien and Jamie Merisotis. A version of this paper will 
appear in Thomas Ehrlich's (editor) forthcoming book, Higher Education and 
Civic Responsibility (Oryx Press). 

r 

The New Millennium Project team is co-directed by Jamie Merisotis, President, 
and Jane Wellman, Senior Associate, at The Institute for Higher Education 
Policy. Project staff include: Colleen O'Brien, Managing Director; Diane 
Gilleland, Senior Associate; Thomas Parker, President of TERI; Katheryn Voile 
Harrison and Alisa Federico Cunningham, Research Analysts; and Christina 
Redmond and Mark Harvey, Project Assistants. 

The project also is being guided by an Advisory Group of national experts in 
higher education. Advisory Group members include: 

► Vera King Farris, President, Richard Stockton State College; 

► Augustine Gallego, President, San Diego Community College District; 

► D. Bruce Johnstone, Professor of Higher Education, SUNY Buffalo; 

► Gerald Monette, President, Untie Mountain Community College; 

► Barry Munitz, President and CEO, The J. Paul Getty Trust, Chair; 

► Michael A. Olivas, William B. Bates Professor of Law, University of Houston; 
and 

► Carol Stoel, Co-Director, Tfeacher Education, Council for Basic Education. 
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Assessing and Accounting 
for the Civic Contributions 
of Higher Education 



Introduction 
and Overview 

T he first report in the New Millennium project, 
Reaping the Benefits; Defining the Public and Pri- 
vate Value of Going to College explored higher education's 
role in serving broad social purposes, examining both 
the public and private benefits of higher education. 
The report argued that the historic understanding that 
higher education benefits both society and the indi- 
vidual has given way to a primary focus on private 
benefits rather than broader public purposes. The 
second report, The TUition Puzzle , explored how this 
shift has been accompanied by increased privatization 
of higher education's funding base. One consequence 
of the eroding public funding has been greater 
fractionalization of the revenue sources, as well as 
an erosion of general financial capacity to serve broad 
public purposes. 

This paper examines in greater detail how higher 
education serves the larger public good, focusing on 
how higher education assesses and accounts for its 
service to society. It begins with a brief discussion of 
how the civic education of students and institutional 
service to society are defined for the purposes of this 
paper. It then discusses assessment and accountabil- 
ity strategies, including the kinds of measures that 
tend to be the focus of most public reporting strate- 



gies. Despite all the attention to assessment and ac- 
countability, higher education's civic education and 
service roles are not on the radar screen of these ef- 
forts. When civic contributions are assessed, some- 
thing else— service learning, campus climate, diversity, 
student/faculty engagement, or “service" to the com- 
munity, sometimes reported as faculty service to the 
institution— is measured. These assessments may 
provide some information about civic contributions, 
but only indirectly, and never about both the teach- 
ing and community service roles. Further, there are 
no “road maps" connecting institutional assessments 
with public accountability for the civic teaching and 
service roles. As a result, the responsibility to play a 
civic education and service role is generally missing 
from public policy discussions about the purpose and 
effectiveness of higher education. 

In an era dominated by the twin themes of 
privatization and accountability, and in light of erod- 
ing public funding for higher education, it is essen- 
tial to build assessments of the civic contributions of 
higher education into ongoing accountability reports. 
Yet assessing and accounting for civic contributions 
can be difficult; this paper identifies obstacles that 
need to be understood and overcome in order for these 
processes to begin. Because no models for document- 
ing these contributions exist, this paper presents some 
strategies for building assessment and accountability 
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capacities for the civic roles of higher education. The 
strategies are drawn from assessment models cur- 
rently being used to measure specific dimensions of 
campuses' civic roles and activities. 

Defining the Civic Role: 

Civic Education and 
Community Service 

I solating higher education's civic roles is difficult 
to do because most of its activities serve public 
purposes in some way. The instructional mission— 
and particularly the mission to ensure access to low- 
income and minority students— serves a general 
public purpose. University research also is performed 
for the most part in the public domain and for the 
public good, even if it is funded by private resources. 
However, colleges and universities are not the exclu- 
sive or even predominant institutions in our society 
that serve the public through teaching, research, and 
service: proprietary and technical institutions also 
educate students; research is conducted both by gov- 
ernment and the private sector; and philanthropic 
organizations such as charities and churches help 
society through community service. Further, there is 
considerable debate about the relative importance of 
higher education's civic role as compared to that of 
public elementary and secondary education and the 
philanthropic sector. 

On the other hand, public and non-profit collegiate 
higher education institutions have broad civic pur- 
poses at the core of their missions that are not cen- 
tral to the purposes of these other institutions. The 
nexus of education, research, and service is the focus 
of this paper, in which the “civic contributions" of 
higher education mean both its civic education and 
institutional service roles. The “civic education role" 
is the broad-based education of students to be effec- 



tive citizens in a democratic society, and “institutional 
service" is the combination of individual faculty, stu- 
dent, and staff efforts, as well as organized institu- 
tional activities that serve the community. 

Many interesting questions may be raised about why 
higher education as a matter of public policy should 
have a civic role, since it is a function that is also per- 
formed by other social institutions. In addition, not all 
higher education institutions place the same priority 
on civic education and service; nor should they be ex- 
pected to do so. (This paper avoids that debate, except 
to note that it exists.) The fact remains that higher edu- 
cation is the one endeavor that brings together teach- 
ing and credentialing functions with knowledge 
creation and preservation, alongside expected service 
to communities and the public. Consequently, it per- 
forms a unique civic role. 

The National Assessment 
and Accountability Scene 

T he past 15 years have witnessed significantly 
increased attention to assessment and account- 
ability in higher education. Unlike earlier eras when 
institutional research and evaluation capacities 
tended to be largely administrative responsibilities, 
newer approaches to assessment are designed to en- 
gage faculty and administrators in efforts to improve 
quality, particularly in teaching and learning. Ac- 
countability tools are used at the system and state 
levels to tie assessment to performance, not only for 
purposes of institutional improvement, but to guide 
state resource decisions and to enforce state standards 
for achievement. 

Attention to assessment as a tool for improvement 
was promoted initially in the mid-1980s through a 
series of national reports that sounded an alarm about 
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the potential decline in the quality of American higher 
education; the alarm was accompanied by a call for 
reflection, evaluation, and reform. Prominent reports 
that continue to influence this discussion include the 
Association of American Colleges and Universities' 
Integrity in the College Curriculum: A Report to the Aca- 
demic Community (1985), the National Institute of 
Education's Study Group on the Conditions of Excel- 
lence in American Higher Education's Involvement in 
Learning (1984), and the National Endowment of the 
Humanities' Tb Reclaim a Legacy : A Report on the Hu- 
manities in Higher Education (1984). 

Assessment models have sprung up across the coun- 
try, helping to guide institutions' inquiries about ways 
and means to improve the teaching and learning func- 
tion. A quick scan of the papers presented since 1987 
at the annual meetings of organizations devoted to 
assessment shows the intensity of interest in the topic 
and the range of ways in which institutions go about 
it. The assessments' focuses range from student skill 
assessment, to faculty, to curriculum. Some institu- 
tions' efforts are more topical: assessment of campus 
climate as part of the campus diversity initiative, or 
assessment of the effectiveness of service learning in 
improving academic learning outcomes. Over the 
years, the assessment agenda increasingly has become 
focused on ways to document student learning out- 
comes in terms of measurable competencies and 
other outcomes, in order to test the relative effective- 
ness of different modes of teaching and course deliv- 
ery. 1 

Coinciding with the assessment movement has been 
growing interest in state-based accountability mea- 



sures. While the terms of the conversation are rarely 
defined, the thread running through most state ac- 
countability reports is attention to assessment and 
improvement, resource use, and performance on 
state-defined standards. Further, whereas institu- 
tional assessments by nature focus on specific insti- 
tutions, statewide accountability reporting results in 
interinstitutional comparisons on state performance 
measures. 

A study by the National Center for Postsecondary 
Improvement at the University of Michigan reports 
that 42 states have postsecondary assessment poli- 
cies in place and that most of them are moving from 
an exclusive focus on institutional assessment to link- 
ing assessment with accountability. The types of per- 
formance indicators that are being put into 
accountability frameworks reveal a good deal about 
the indicators that are most likely to be used to de- 
fine the core enterprise, as well as to distribute re- 
sources. South Carolina and Tennessee are the two 
states that generally are perceived to have gone the 
furthest (for good or ill) to promote accountability 
measures. A review of the reporting format for those 
states shows the following measures: 2 

South Carolina: Institutions must provide 
information on: instructional expenditures; 
curriculum; mission statement; plans and 
achievements; faculty credentials; faculty 
review, including student, peer, and post-ten- 
ure review; faculty compensation; availabil- 
ity of the faculty to students outside the 
classroom; community and public service ac- 
tivities of the faculty for which no extra compen- 



1. The literature on assessment is substantial and includes some good material on trends in the assessment "movement." Interested 
readers should scan the web pages of the American Association for Higher Education (AAHE), the Association for Institutional Re- 
search, EDUCAUSE, the Association of American Colleges and Universities, and the Council for Higher Education Accreditation (CHEA). 

2. Nettles, 1997. 
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sation is paid; class sizes; student/ teacher ra- 
tios; number of credit hours taught by fac- 
ulty; ratios of full- to part-time faculty; use of 
best management practices; ratio of admin- 
istrative to academic costs; reduction in "un- 
justified duplication" of course credits; 
amount of general overhead costs; high school 
class standing; GPAs and activities of students; 
graduation rates; employment rates; em- 
ployer feedback on graduates; and the num- 
ber of students continuing their education. 

Tennessee: Institutions must provide infor- 
mation on: performance of graduates on 
approved standardized tests of general edu- 
cation; performance of graduates on approved 
examinations in major fields of study; satis- 
faction of alumni and enrolled students; 
program accreditation; quality of non- 
accreditable undergraduate programs by ex- 
ternal review; quality of master's degree 
programs by external review; and level of 
minority enrollment and enrollment vis-a-vis 
mission [emphasis added]. 

It is not an exaggeration to say that civic teaching 
and service are scarcely on the national accountabil- 
ity agenda. Even South Carolina, which has taken a 
"kitchen sink" approach to accountability reporting, 
just touches upon the topic in a single measure of 
"service" that is related to faculty time yet does not 
"count" if it is compensated. Other forms of institu- 
tional service, including organized activities such as 
museums and galleries, public clinics, collaborations 
with schools, local economic development, and ser- 
vice to local government, are not mentioned; nor is 
any aspect of the teaching and learning role. 



Why Assess Civic Contributions? 

"There is only one argument for doing 
something; the rest are arguments for doing 
nothing. The argument for doing something 
is that it is the right thing to do." 

— F. M. Cornford, 
Microcosmographica Academica: Being a 
Guide for the Young Academic Politician 

P robably the best argument for assessing and 
accounting for higher education's civic teaching 
and service roles is that it will help to maintain these 
roles, which is the right thing to do because it is in the 
public interest for higher education to continue to serve 
in these civic and community roles. A second— and 
not insignificant— reason is that institutions increas- 
ingly are being held "accountable" for their accomplish- 
ments through performance-based report cards that 
link funding with evidence of results. Without some- 
effort from within higher education to put its civic role 
into the accountability agenda, public and political mea- 
surement of higher education's "results" will continue 
to focus on performance measures that are much more 
utilitarian. In the words of the former inspector gen- 
eral for the U.S. Department of Education as he testi- 
fied before Congress on accountability and quality, "If 
you can't count it, it doesn't count ." 3 Higher education 
is at risk of being hoisted on the petard of empiricism; 
institutions that deliver educational "product" at the 
lowest possible cost— including vocational institutions 
that show good graduation and job placement rates— 
will look good. More important, the potential exists 
that those aspects of higher education's role that have 
yet to be objectified— in particular, the responsibility 
to educate students to be effective citizens and to serve 
the public interest— will erode further to be replaced 
by more utilitarian measures. 



3. James Thomas, 1994. 
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The public accountability agenda also needs to be 
engaged because of the erosion of funding for both 
public and private non-profit higher education. The 
social funding compact between states and traditional 
forms of higher education is based on an understand- 
ing that public investment is justified by higher 
education's broad social benefits. The investment is 
made in the form of direct appropriations in the pub- 
lic sector and through tax-exempt status in the non- 
profit sector. (The theory behind tax exemption for 
non-profit institutions is that the public services they 
provide otherwise would have to be paid for by the 
state). Although the state funding declines of the late 
1980s and early 1990s have abated, the consensus is 
that the long-term funding trajectory for higher edu- 
cation is largely negative. Appropriations for public 
institutions have been made vulnerable by growing 
demands for entitlements and corrections. 

Private non-profit institutions also face threats to their 
tax-exempt status— particularly local property tax ex- 
emptions— as cash-strapped municipal governments 
look for ways to bolster their revenues. Both public 
and independent higher education face competition 
from the “new providers" of postsecondary education, 
for-profit, vocational, and distance-based providers. 
These new providers claim to be able to deliver educa- 
tion more efficiently and effectively than traditional 
colleges, without benefit of either direct appropriations 
or tax-exempt status. Yet they typically do not claim to 
perform a broader civic or community service role, 
either in the education of students or in service to com- 
munities. If collegiate institutions are to retain their 
privileged positions within society, benefiting from 
public support and tax-exempt status, more attention 
must be given to documenting the reasons the public 
should then invest in institutions that are responsible 
not just for teaching and job preparation, but also for 
research and service to society. 



Finally, assessment of civic teaching and service will 
require deeper exploration of the meaning and mea- 
sure of civic contributions. Civic learning and service 
contributions are so poorly understood that even find- 
ing simple activity and outcome measures will require 
an engaged conversation about values and purposes, a 
definition of terms, and ways to demonstrate evidence 
of achievement. Framing the conversation in the con- 
text of measurement and public accountability can help 
prevent overly abstract or ideological discussion. 

Where to Start 

A lthough civic teaching and service contributions 
have not been the focus of assessment or ac- 
countability measures, aspects of these functions are 
latent in some of the assessments that have been 
conducted; some lessons may be learned by review- 
ing that work. A brief overview of the places which 
offer the most promising ideas follows. (Please note 
that this review is not meant to be comprehensive. 
Additional information about resources is provided 
in the appendix). 

A. Evaluations of service learning. Service learning is 
the area of inquiry where the most has been done to 
assess civic teaching and community. Some of the as- 
sessments focus on student outcomes from service 
learning, including, for example, self-reports of active 
learning, community in the classroom, attitudes toward 
service and service learning, academic persistence, 
leadership, and career clarification. Others focus on 
community service and the degree to which the cam- 
pus and community are engaged in healthy partner- 
ships. Research shows that the kinds of outcomes that 
are equated with service learning are both cognitive 
and affective. With regard to cognitive learning, re- 
search shows that service helps students learn and 
retain subject matter content; it also enhances their 
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ability to synthesize information and to reason ana- 
lytically. With regard to affective learning, there are 
positive outcomes on student attitudes and values, in- 
cluding self-esteem, personal aspirations, ability to 
work with others, and resistance to authoritarianism. 
For both cognitive and affective learning, these out- 
comes might be good initial proxies for a discussion 
about goals for effective citizenship . 4 

B. Assessments of campus climate and campus di- 
versity initiatives. Another area where interesting 
work has been done is that of campus climate and 
diversity, where assessments have touched upon the 
goals of higher education to educate for interpersonal 
capacities, including citizenship skills. The assump- 
tion underlying much of this work is that the chang- 
ing social and economic fabric of our culture will 
require that students be able to work collaboratively 
in ethnically and culturally diverse environments. 
Respect and sensitivity toward others' values and prob- 
lem solving, team building, and collaboration skills 
typically are developed from these initiatives as teach- 
ing and learning goals. 

Assessment instruments have been developed to help 
institutional officials "take the temperature" of their 
campus learning climates in order to define goals and 
determine means to ensure inclusive and collabora- 
tive learning communities. In addition to institutional 
assessments, the research also shows positive learn- 
ing outcomes— particularly in learning skills and re- 
spect for others— for students who have been educated 
in diverse campus environments. Thus, the work on 
diversity and campus climate provides some clues as 
to how to define and measure aspects of "good citizen- 
ship," as well as how to equate these capacities with 
other dimensions of educational quality. 



TWo resources are particularly helpful: one is a re- 
cent summary of research on diversity by Daryl 
Smith of Claremont Graduate School and published 
in the Association of American Colleges and Uni- 
versities' monograph Diversity Works , and the other 
is some University of Michigan commissioned re- 
search contained in "The Compelling Need for Di- 
versity in Higher Education." Both reports 
summarize a range of research about the conse- 
quences of campus diversity for students, and 
Smith's study includes an annotated bibliography of 
pertinent research. The Michigan report includes a 
background study by Patricia Gurin about the rela- 
tionship between student learning in diverse learn- 
ing environments and what she terms "democracy 
outcomes." She uses longitudinal data both from 
national sources and from the University of Michi- 
gan. Her analyses show consistent positive correla- 
tions between education in diverse settings and 
democracy outcomes, including: 

► growth in active thinking processes reflective of 
a more complex, less automatic mode of thought; 

► engagement and motivation; 

► learning a broad range of intellectual and aca- 
demic skills; 

► value placed on those skills; 

► "citizenship engagements" or motivation to par- 
ticipate in activities that affect society and the 
political structure, as well as participation in com- 
munity service; 

► racial/ cultural engagement, a measure of cultural 
knowledge and of motivation to participate in 
activities that promote racial understanding; and 

► compatability of differences, including the belief 
that basic values are common across racial and 



4. See, for example, Portland State University, Assessing the Impact of Service Learning: A Workbook of Strategies and Methods. 
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ethnic groups, the understanding of the potential 
constructive aspects of group conflict, and the 
belief that differences are not inevitably divisive 
to the social fabric of society . 5 

C. Research on student learning outcomes. There is a 
considerable body of research on what students actually 
"get" from college, some of which raises as many ques- 
tions as answers about the specific relation of college to 
student learning outcomes. Nonetheless, it is a rich re- 
source of ways to think about and measure student learn- 
ing outcomes. For example, Alexander Astin has 
developed a taxonomy to characterize learning outcomes 
from college (summarized briefly in the box below ). 6 

Research on the affective, psychological, and broader 
behavioral outcomes of college show some correla- 
tions between college attendance and a range of de- 
sirable social civic capacities: 

► individual autonomy and capacity for indepen- 
dence; 

► less tendency toward authoritarianism, dogma- 
tism, and ethnocentrism; 

► interpersonal relations; 

► maturity and general personal development; 



► intellectual orientation; 

► extent of principled moral reasoning; 

► interest in service to others and friendships; 

► interest in current affairs and domestic and 
foreign politics; 

► cultural and aesthetic sophistication; and 

► voting behavior. 

While the research is inconclusive on many of these 
measures— particularly regarding what it is about 
college that causes some of these outcomes— the in- 
ventory of capacities is nonetheless helpful in think- 
ing through ways to describe and potentially 
document measurable citizenship skills. 

D. Research on the institution as citizen: commu- 
nity service. While surrogate measures of different 
aspects of civic teaching and learning can be teased 
out from the literature, there is very little to draw 
from for measures of institutional service to the com- 
munity. This may be because so much of the assess- 
ment and accountability agenda is focused on 
improving the teaching and learning functions. It also 
is possible that what otherwise might be labeled "in- 
stitutional service" is counted instead as research. 



Outcomes 


Cognitive: Higher-order intellectual 
processes— knowledge acquisition, 
decisionmaking, synthesis, reasoning 


Affective: Attitudes and values, 
self- concepts, aspirations, 
personality dispositions 


Measures 


Psychological: Internal states or 
traits of the individual measured 
through tests or examinations 


Behavioral: Direct observation 
of the individual 



5. Gurin, 1999, p. 114. 

6. Astin, 1973. 
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Research by Fran Ansley and John Gaventa reported 
in a 1997 special edition of Change Magazine on 
“Higher Education and Rebuilding Civic Life" suggests 
that there are new models of community-university 
research partnership; these they call these "The New 
Research." They describe a number of programs and 
centers that have emerged to tie university research 
to community and government needs. Some are de- 
signed to address particular themes or topics (for ex- 
ample, the environment, urban planning, schools, or 
housing), and some serve as a basis for connecting 
faculty interested in action research with community- 
based organizations. 

Nancy Thomas has done work on institutional ser- 
vice for the New England Resource Center for Higher 
Education and suggests a useful typology for catego- 
rizing different types of institutional service 
activities: 

1. cooperative extension and continuing education 
programs; 

2. clinical programs and field-based learning oppor- 
tunities for students in professional programs; 

3. top-down administrative initiatives; 

4. centralized administrative-academic units with 
outreach missions; 

5. academically based centers and institutes; 

6. faculty professional service and academic out- 
reach; 

7. student initiatives; 

8. institutional initiatives with an economic or po- 
litical purpose; and 

9. access to facilities and cultural events. 7 



7. Nancy Thomas, forthcoming, p. 15. 
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Compendiums of information about university ser- 
vice activities are another common form of assess- 
ment as it applies to institutional service. There are a 
number of examples of institutional efforts to catalog 
community service activities into comprehensive re- 
ports, which describe a host of activities, from com- 
munity-based faculty scholarship, to clinical activities, 
university extension, community government part- 
nerships, and student internships with community 
based organizations. Unfortunately, these reports tend 
not to synthesize the data; nor do they generalize 
about how to characterize the nature of the institution's 
service role. 

Institutions and systems also periodically develop 
estimates of their economic impact on the surround- 
ing community. Economic impact is not synonymous 
with community service, but such assessments may 
offer some ideas about activities that, while centered 
on the campus, affect the community. Sometimes 
prepared as a defense against local governments' 
threats to rescind property tax exemptions (as well as 
for other reasons), these surveys compile economic 
impact data by counting funds expended as a conse- 
quence of the institution's many activities— for ex- 
ample, employer, construction contractor, purchaser 
of goods, hospital,, clinic, and dormitory managers, 
research contractors— and estimate their "multiplier 
effects" on local businesses. Students are a prime ex- 
ample of a good multiplier because they live and 
spend money in the communities by patronizing lo- 
cal businesses. Economic activity reports can be help- 
ful in stimulating thinking about the many types of 
organized activities that typically emanate from all 
kinds of colleges and universities and also about the 
institution's responsibility to be a "good citizen" 
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itself. Reports may help pave the way further toward 
thinking about areas of current public concern, such 
as the use of foreign sweatshop labor to manufacture 
collegiate sportswear. 

E. College ratings services. Private rankings of col- 
leges have been around for a long time, but until the 
early 1990s, most focused on graduate or professional 
programs. Since that time, rankings of undergradu- 
ate colleges and universities on the basis of various 
indicators have started to abound, led by several na- 
tional magazines. Research on ranking services for 
the Council for Higher Education Accreditation indi- 
cates that most of them equate "quality" with fairly 
traditional peer reviews of reputation and resources, 
faculty credentials, and undergraduate student selec- 
tivity. But a few of them— in particular, The Princeton 
Review surveys— are designed to test student percep- 
tions of college quality, looking at indices such as stu- 
dent service, student activism, campus spiritual life, 
and diversity. 8 A review of these guides can stimu- 
late thinking about the kinds of things students equate 
with quality, including candid appraisals of place as 
a dimension of effectiveness. 

One ranking service in particular is designed to assess 
institutional commitment to "character education," 
which is at least one dimension of civic education. The 
Tbmpleton Foundation Guide to College and Character 
is designed to address the eroding role of colleges and 
universities in character education by identifying out- 
standing programs that help foster personal and civic 
responsibility. Foundation materials state: 

Ample evidence suggests that too many of 
our nation's colleges and universities have 



experienced an erosion of vision regarding 
their responsibility to educate students who 
personally define and affirm a set of moral 
and civic commitments. The clear and prag- 
matic task of preparing students for a profes- 
sion has pushed aside the more controversial 
and difficult task of inspiring students to lead 
ethical and civic-minded lives. 9 

Competitions are promoted in a number of areas, in- 
cluding identification of exemplary first-year pro- 
grams, civic education programs, service learning, 
academic integrity, and presidential leadership. Cri- 
teria that are used to rank institutions include: 

► a strong statement of purpose, showing the pri- 
ority of character development in the institution's 
mission; 

► evidence of active involvement in character 
education by the institution's leaders, including 
faculty; 

► longevity of the programs; 

► evidence of the program's positive impact on stu- 
dents, faculty, the campus, and the community; 

► evidence of impact on a significant percentage of 
students; 

► integration of the program into the core curricu- 
lum and areas of academic study; 

► evidence of a central campus location that pro- 
vides program information, recruitment and pub- 
licity, training, and coordination; 

► external recognition or honors; and 

► assessment and evidence. 



8. For further information, see The Princeton Review website: http://www.review.com/college-Rankings. 

9. For further information, see the Tfempletoh ‘Foundation website: http://www.templetpn.org/character. 
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F. INCH: The Index of National Civic Health. The 

1997 final report of the National Commission on 
Civic Health, America's Civic Condition alerted read- 
ers to the deteriorating quality of the nation's civic 
life and issued a multifaceted call for civic renewal, 
including specific recommendations about roles for 
schools, community organizations, and churches. 
One of the commission's recommendations was for 
periodic assessments of the quality of civic life, to 
be carried out by “The Civic Monitoring Project." 
Such assessments would enhance the public and 
policymakers' awareness of the condition of civic 
life. The Index of National Civic Health (INCH) is 
the assessment tool the commission developed to 
gauge national civic health. INCH is an average of 
22 different indicators, all drawn from generally 
available data that can be monitored over time, and 
combined into five categories: political, trust, mem- 
bership, security, and family. (See the appendix for 
a more complete description of INCH.) 

INCH does not purport to measure higher education's 
civic contributions— either in student teaching or com- 
munity service. In fact, the role of higher education 
as part of either the problem or the solution of the 
deteriorating national civic health was not mentioned 
by the commission. Nevertheless, INCH could be 
adapted to an index of higher education's civic con- 
tributions. Categories appropriate to higher education 
could be developed in place of their five categories. 
Decisions about what to count should be made at the 
institutional or state level, but examples might include 
student learning outcomes; student/ community in- 
volvement (number of students participating in ser- 
vice learning or other measures of volunteerism); 
faculty service to communities; institutional/commu- 
nity collaboratives (clinics, school partnerships, hous- 
ing, number of individuals served by university/ 
community activities, number served in hospitals and 

er|c 



clinics; number of students in K-12 partnership 
collaboratives, children in campus-run daycare cen- 
ters); and measures of the use of the campus as pub- 
lic space benefiting the community (concerts, public 
debates, athletic events). INCH is a worthwhile model 
because it synthesizes many complex indicators into 
an aggregate index that can be tracked over time. 

Developing a Strategy 

E ven if assessing civic responsibility is “the right 
thing to do," it also is a tricky thing to do. As- 
sessment will direct institutional attention to the issue 
of civic roles, possibly at some cost to the institution. 
An aborted assessment effort could torpedo already 
fragile institutional commitments to service and civic 
education. Before embarking on assessment and ac- 
countability, an assessment plan should be developed; 
it should begin with an analysis of hurdles to be over- 
come and strategies for doing so. 

Obstacles to Assessment 

While the specifics will differ according to the insti- 
tution, several potential obstacles to assessment are 
likely to emerge. The obstacles may result from any 
of the following: 

1. The topic is undefined. No consistent vocabulary 
exists for framing an assessment of higher education's 
civic teaching and service roles. What does civic edu- 
cation mean, and how should it be measured? What 
is the community service role, and what activities 
constitute pieces of it? What are the dimensions of 
community service responsibility for a community 
college? For a residential campus? For a research 
university? What are specific indicators of the way in 
which this role is carried out? In the absence of terms 
in which the topic can be readily discussed, assess- 
ments make little sense. 
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2. The civic teaching and service roles are not priori- 
ties. Part of the reason civic teaching and service ac- 
tivities are not assessed or accounted for stems from 
the fact that these roles are not a high priority for 
either the institutions or their patrons (students, 
parents, states, and other benefactors). Many believe 
that effective undergraduate education, preparing 
students for jobs, and contributing to economic de- 
velopment through both basic and applied research 
are higher education's essential purposes. Surveys 
indicate that most students enroll in college prima- 
rily to get a good job and have a better life. Institu- 
tions do not have the resources to do everything, 
and assessment and improvement of something no 
one is specifically asking for legitimately can be 
given low priority. 

3. No one within the college or university has the job 
assignment. Civic teaching and community service 
may be everyone's responsibility but no one's job. 
Students' civic learning is presumed to be a byproduct 
of the collegiate educational experience— a product 
of students' "fusion" with the faculty, the curriculum, 
and the co-curriculum. Likewise, many believe that 
institutions serve society through teaching and re- 
search, not through a separate set of activities. Build- 
ing successful assessment strategies will require both 
assigning the responsibility for assessment to an in- 
dividual in the institution and discussing the ways in 
which the different aspects of campus life contribute 
to civic teaching and service. 

4. It is difficult to separate the civic roles from the teach- 
ing and research roles. The civic education and ser- 
vice roles are truly interdependent on the institution's 
teaching and research missions. More than teaching 
or even research, it is difficult to isolate these capaci- 
ties from other dimensions of institutional effective- 



ness. Can an assessment of the "civic dimension" be 
separated from other assessments? Should it be? 
Those who are familiar with typical academic ap- 
proaches to measuring joint products between teach- 
ing and research are aware of some of the analytic 
contortions that higher education is accustomed to 
performing with regard to these kinds of issues. There 
must be a more straightforward way to think about 
civic teaching and community service, but how? 

5. Service activities are not the administrative responsi- 
bility of the college or university. Many community-ori- 
ented activities are not administered by the college 
or university, even though they may depend on or 
involve university employees or students. Examples 
include certain activities at university research parks 
and some university/community activities in major 
urban centers. Whether these are properly labeled 
"service" or "instruction" or "research" is unclear, 
though it is clear that insofar as the university is con- 
cerned, they do not exist if they are not budgeted in- 
side the academy. Documenting these efforts as 
legitimate institutional activities or outcomes will 
require some capacity to know how to track people 
and their contributions, even if the money that funds 
them comes from outside the institution. 

6. Civic education and community service issues are too 
values-laden to be "safe." These are not consensus is- 
sues. Some people believe that civic education is the 
job of K-12 schools and therefore is inappropriate in 
higher education. Some believe that colleges should 
educate students to participate in the global market- 
place rather than to be effective members of a demo- 
cratic society. (Others believe these are two sides of 
the same coin.) Still others liken citizenship educa- 
tion to sex education: it is best left to the church or 
the family. 
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Getting Started: Building 
Successful Assessment Capacities 

1. Start with assessments conducted in the context 
of institutional mission and as a dimension of qual- 
ity. A solid argument can be made that clarity about 
terminology needs to precede assessment and that the 
first stage in the assessment agenda therefore needs to 
be an inquiry into the meaning of effective citizenship 
and institutional service. While that is intellectually 
correct, getting started with assessment is a good way 
to promote a discussion about terminology without 
getting bogged down in abstractions. In addition, the 
terms will be defined differently from institution to 
institution according to their mission, history, and fu- 
ture objectives. The expedient way to proceed is to 
begin the assessment agenda at the institutional level 
in the context of mission and as a dimension of qual- 
ity, rather than as something wholly separate from 
"normal" institutional measures of quality. Integrating 
civic assessment into institutional quality review also 
puts the issue squarely onto the agenda of existing 
quality assessments done through program review, 
institutional strategic planning, accreditation, and state 
accountability reporting. Not only does this help frame 
the civic role as a dimension of quality, but it also helps 
avoid duplication of effort. 

2. Leadership commitment. A successful assessment 
strategy must begin with a commitment by institutional 
leaders to engage the agenda. If enhancing the civic 
teaching and learning and community service roles is 
not a priority, then assessment probably is not a worth- 
while endeavor. Ideally, leadership should begin with 
the college president, though he or she does not have 
to be directly involved. In fact, in certain instances, 
visible presidential leadership might prove counterpro- 
ductive. The agenda should be managed by a core of 
individuals including the academic vice president, the 
budget office, faculty, and students. From that core the 
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capacity to build the agenda by linking with others— 
including governing board members and community 
leaders as a first priority— can be developed. 

3. Test stakeholder perceptions and build awareness. 

The assessment process should begin with a system- 
atic evaluation of the perceptions and values of key 
stakeholders to determine what priority they give civic 
teaching and community service and to learn more 
about the language used to characterize the civic role. 
This could be used to assess views within the institu- 
tion— those of faculty, administrators, governing board 
members, and students— and from external commu- 
nities, including the business community, parents, lo- 
cal community leaders, and statewide elected officials. 
Questionnaires, interviews, and focus group discus- 
sions are all appropriate means of performing this as- 
sessment. The instrument should be designed to 
capture information about how people think and feel 
about the issues, as well as the values that frame how 
they talk about them. Do people think about these is- 
sues? When they do, do they feel positively about 
them? Do they think about them a good deal and feel 
passionately about them? If they are not interested in 
the civic teaching or institutional service roles, what 
are their priorities for higher education? 

The assumption that the primary benefactors of 
higher education do not believe that civic contribu- 
tions are a priority may well be wrong; it is possible 
that they constitute a latent rather than an explicit 
priority. Preliminary assessments of the priority ma- 
jor institutional stakeholders give to the civic teach- 
ing and service roles is essential to developing a 
strategy to strengthen these roles. 

4. Build a strategy to sustain a values-based conver- 
sation. The initial test of perceptions is valuable in 
part because it will reveal whether stakeholder groups 
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Sample Assessment Matrix 



Dimension 


Teaching and 
Learning 


Institutional 
Community Service 


External 

Accountability 


Goals 








Indicators 








Measures 









characterize civic and service issues differently, as well 
as the extent to which the topic is "ideologically loaded." 
One of the unfortunate realities of our culture is that 
values-based conversations sometimes are perceived 
as political or ideological. This is likely to be a bigger 
problem on some campuses than on others. For ex- 
ample faith-related colleges typically find it less diffi- 
cult to engage in conversation about values as a 
dimension of institutional mission than others. If pub- 
lic discussion of the civic role is perceived as having 
been dominated by one group or another, or if it dete- 
riorates into another version of the "culture wars", then 
it is likely to be interesting but not task oriented. Cam- 
pus leaders seeking to sustain this agenda will have to 
test the ideological issues on campus and strive to in- 
clude diverse groups in the process. 

5. Develop an assessment matrix, using separate 
cells for teaching, service, and accountability. While 
it is important to combine the assessments of civic 
teaching and service and the accountability agenda, 
they are sufficiently distinct that the actual instru- 
ments should be developed separately. Each should 
have at least three elements: goals, indicators, and 
measures. The data from these three pieces can be 
reaggregated, and overall institutional evaluations can 
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be made in the context of broad-based institutional 
goals. An assessment matrix similar to that shown 
below can help guide the discussion. 

Where possible, indicators should be reasonably easy 
to measure, yielding information that can be moni- 
tored over time. Searching for "perfect" indicators is 
likely to be less helpful than agreeing on some that 
will be easy to measure and that will enable a num- 
ber of indicators to be tracked over time. The assess- 
ments should build on existing student and 
institutional assessment instruments to get at infor- 
mation which can serve as a proxy for aspects of the 
civic role. For example, most campuses distribute 
annual questionnaires of student perceptions and 
interests. Others routinely survey employers to learn 
of their training needs and degree of satisfaction with 
the institution's students and curriculum. Many also 
try to conduct exit interviews with at least a sample 
of graduates. All of these methods should yield infor- 
mation that can be used for civic teaching and ser- 
vice assessments. 

6. Seek partner institutions to help build the pub- 
lic accountability agenda. The public accountabil- 
ity agenda will be strengthened greatly if a number 
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of institutions in a region join together in a multi- 
institutional assessment and accountability agenda. 
A multi-institutional strategy is particularly impor- 
tant to capture cross-institutional contributions to 
the teaching role, since the majority of students no 
longer receive their education from one or even two 
institutions, but instead are "autodidactic," largely 
self-taught, and move rapidly from one organization 
to another. Collaborating with other colleges on this 
agenda will build the capacity for public account- 
ability that goes beyond the contributions of an in- 
dividual institution. This issue is particularly well 
suited for multi-campus treatments in statewide re- 
porting formats. 

7. Keep it short and clear. Tbo often, higher educa- 
tion quality assessments become so intricate that they 
implode from their own weight— useful for neither 
reviews of goals and performance nor external com- 
munication of capacities. Excessive complexity is a 
natural and predictable result of the consultative pro- 
cess that typically is used to develop assessment 
instruments in higher education. But for this kind of 
work, it is better to err on the side of simplicity than 
complexity, lb ensure the clarity of the assessment, 
knowledgeable and credible individuals who have not 
been directly involved in the process should be asked 
to critique it at different stages of development. It 
should be their responsibility to maintain focus and, 
if possible, brevity. 

Summary and Conclusion 

Higher education does a poor job of assessing and ac- 
counting for its civic teaching and community service 
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roles. Yet assessment and accountability can be criti- 
cal strategic tools for strengthening these roles. While 
no existing models can be adopted in their entirety for 
civic assessments, similar work has been done and can 
serve as both a reference point and a springboard for 
ideas. Civic assessment should be approached as a di- 
mension of institutional quality, and it should be 
framed in the context of individual institutions' mis- 
sions. At the same time, institutional assessments 
should be developed with attention to developing pub- 
lic accountability capacities, since external public com- 
munication is essential to the success of the agenda. 
This is not a narrow or technical job that can be foisted 
off on the institutional research office or left exclu- 
sively in the hands of the academic senate; success- 
ful assessments of civic capacities require the 
commitment of institutional leaders and should in- 
volve both administrative and academic personnel. 
An assessment strategy should be developed that 
anticipates the particular institutional hurdles that will 
need to be overcome, including strategies to ensure 
that the public conversation about goals and values is 
not monopolized by particular ideological factions 
within the community. Instruments that use readily 
available data that can be replicated and measured 
over time will be most helpful. 

Institutions interested in engaging the civic agenda 
will find the development of assessment instruments 
a particularly helpful way to initiate a task-oriented 
and meaningful conversation about purpose, prior- 
ity, measures, and effectiveness. There is some sci- 
ence to assessment, but it is not rocket science. With 
commitment and good will, as well as some imagina- 
tion, it can and should be done. 
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APPENDIX 



Resources for Further Information 

The American Council on Education's (ACE) 
Higher Education and Democracy Forum is a 

source of information about institutional community 
service activities. For its first meeting, held in June 
1998 in Thllahassee, Florida, the Forum asked partici- 
pating institutions to provide listings of their institu- 
tional service activities. This compendium of 
information maybe obtained from ACE by requesting 
the background papers for the conference. Contact 
ACE, One Dupont Circle, Eighth Floor, Washington, 
DC 20036, (202) 939-9331. 

The Association of American Colleges and Uni- 
versities (AAC&U), in conjunction with the Univer- 
sity of Maryland, has developed a comprehensive 
resource-sharing network for information about di- 
versity initiatives, including a database of research 
about evaluations of campus diversity projects. In 
addition to serving as an entry point to the literature, 
this is an excellent guide to institutions that have ex- 
perimented with diversity initiatives. Contact AAGS'U, 
1818 R Street, NW, Washington, DC 20009, (202) 884- 
7419, website: http://www.aacu-edu.org. Also, visit 
the AAC&TJ and University of Maryland database on 
campus diversity initiatives at: http://www.inform. 
umd.edu/diversity. 

The California Postsecondary Education Com- 
mission developed a "Campus Climate Assessment 
Instrument" that has been used successfully on cam- 
puses throughout California. The Western Associa- 
tion of Schools and Colleges — the regional 
accrediting commission for California— has em- 
braced the instrument as a means of encouraging 



campuses to engage in self-assessment of campus 
diversity. The commission also sponsored research 
to measure higher education's contributions to the 
California economy. Contact The California 
Postsecondary Education Commission, 1303 J Street, 
Suite 500, Sacramento, California 95815, (916) 322- 
8028, and the Western Association of Schools and 
Colleges, PO Box 9990, Mills College, Oakland, CA 
94610, (510) 632-5000. 

Campus Compact is the national network of nearly 
600 colleges and universities and 20 state networks 
committed to student citizenship and values devel- 
opment through public and community service. Ori- 
ented both to service learning and students' and 
campuses' civic development, Campus Compact has 
developed a substantial body of research on service 
learning and its consequences. In addition to provid- 
ing statistical information about basic trends in ser- 
vice learning, Campus Compact is a resource for 
information about which college campuses are in- 
volved in both service learning and community ser- 
vice. For more information, contact Campus Compact, 
Box 175, Brown University, Providence RI 02912, (401) 
863-1119, website: http://www.compact.org 

The Council for Higher Education Accreditation 
(CHEA) has developed a n Almanac of Quality Assur- 
ance, a guide to the forms of external quality assur- 
ance review in higher education, ranging from 
accreditation to state licensure, state accountability 
reporting, and external ratings services. Copies of The 
Almanac can be obtained from the Council for Higher 
Education Accreditation, One Dupont Circle, Fifth 
Floor, Washington, DC 20036, (202) 955-6126, website: 
http://www.chea.org 
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The Corporation for National Service is the body 
created in 1992 by federal legislation designed to pro- 
mote community service in higher education. A public/ 
private partnership, the corporation oversees three 
national service initiatives: AmeriCorps, Learn and 
Serve America, and the National Senior Service Corps. 
The legislation that created the corporation requires 
ongoing evaluation activities, including periodic ef- 
forts to define performance goals and measure per- 
formance indicators. For more information, contact 
Corporation for National Service, 1201 New York Av- 
enue, NW, Washington, DC, (202) 606-5000, website: 
http:// www.nationalservice.org 

The Higher Education Research Institute (HERI), 

at the University of California, Los Angeles, is one of 
the best national repositories of data on student learn- 
ing and college outcomes. HERI has managed the na- 
tional annual survey of incoming college freshmen for 
more than 25 years and is a good source of longitudi- 
nal data, as well as many current projects on aspects 
of this topic. For more information, contact Alexander 
Astin, Director, at HERI, 3005 Moore Hall, University 
of California, Los Angeles, CA 90095, (310) 825-8331. 

Indiana University-Purdue University Indianapo- 
lis has been at the forefront of assessing service learn- 
ing in the context of overall institutional change 
strategies. Their assessments focus both on the insti- 
tutional level (the degree to which campuses are ef- 
fectively engaged in their communities) and on the 
long-term impact of service learning on students. The 
campus-based assessment has three stages: (1) devel- 
oping of a portfolio of activities; (2) rating the campus 
effort; and (3) making recommendations for future 
work. In addition, it is beginning to work on a way to 
assess the effects of long-term and intensive commu- 
nity work on leadership development, educational as- 
pirations and persistence, career choice, and 
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understanding of the non-profit sector. Contact Indi- 
ana University-Purdue University Indianapolis, Cen- 
ter for Public Service and Leadership, 815 W. Michigan 
Street, Indianapolis, IN 46202-5164, (317) 278-2370. 

INCH: Index of National Civic Health measures five 
components of civic life. (The components' "weights" 
are indicated below.) Data were compiled beginning 
in 1970, when the index was normed to equal 100. 



INCH 

Components 


Elements and Weights of the Total 1 


Political 


Voter turnout (10%) and other politi- 
cal activities (signing a petition, writ- 
ing to Congress, attending rallies or 
speeches, working for a political 
party, making a speech, writing an 
article, writing a letter to the news- 
paper, belonging to a reform group, 
and running for or holding political 
office (1.1% each) 


Trust 


Trust in others (10%) and confidence 
in the federal government (10%) 


Membership 


Membership in at least one group 
and/or church attendance (6.7%), 
charitable contributions (6.7%), and 
local participation, attending local 
meetings, serving on local commit- 
tees, and serving as an officer of a 
local group (2.2% each) 


Security 


Youth murderers per youth popula- 
tion (6.7%), fear of crime (6.7%), and 
survey-reported crime per popula- 
tion (6.7%) 


Family 


Divorce (10%) and non-marital births 
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The National Commission on Civic Renewal's final 
report can be obtained via the Internet at: http:// 
www.puaf.umd.edu/civicrenewal/ finalreport/ 
america's_civic_condition. 

The National Center for Higher Education Man- 
agement Systems (NCHEMS) is just beginning a 
multi-year project, funded by the Pew Charitable 
Trusts, to develop a national assessment instrument 
for the "engaged student." The instrument will be used 
to assess the contributions of learning experiences 
and the campus environment to student learning. 
Vice President Peter Ewell has been one of the lead- 
ing researchers and advocates for student learning 
assessments as an essential dimension of institutional 
instructional quality. For more information, contact 
Peter Ewell, Vice President, National Center for 
Higher Education Management Systems, 1540 30th 
Street, Room 173, Boulder, CO 80303, (303) 497-0301. 

The New England Resource Center for Higher 
Education (NERCHE) is located at the University 
of Massachusetts Boston. NERCHE's mission is to fos- 
ter higher education institutional improvement and 
change through collaborative projects and consulta- 
tion. Work initiated under the leadership of Ernest 
Lytton and Zelda Gamson continues under the di- 
rectorship of Deborah Hirsch and includes a num- 
ber of special services for the engaged campus 
through the faculty professional service project 
(FPSP), the portfolio project, and "Project Colleague" 
to help faculty develop skills in community organiz- 
ing, collaboration, and project management. For 



more information, contact Deborah Hirsch, Execu- 
tive Director, New England Resource Center for 
Higher Education, Graduate College of Education, 
University of Massachusetts Boston, Boston, MA 
02125 (617) 287-7740, e-mail: nerche@umh.edu. 

The Portland State University Center for Aca- 
demic Excellence has produced an excellent hand- 
book, Assessing the Impact of Service Learning: A 
Workbook of Strategies and Methods. The handbook 
focuses not just on student learning outcomes, but 
on ways to assess the impact of service learning on 
all four of its constituencies: students, faculty, the 
community, and the institution. Contact the Center 
for Academic Excellence, Portland State University, 
PO Box 751-CAE, Portland, OR 97207-0751, 
(503) 725-5642. 

The Templeton Foundation Guide to College and 
Character can be accessed through the following 
website: http://www.templeton.org/Character. 

The Walt Whitman Center for the Culture and 
Politics of Democracy at Rutgers University is a 
center for the study of democracy and culture. Direc- 
tor Benjamin Barber has developed models to mea- 
sure dimensions of citizenship which can be helpful 
in defining goals for higher education's civic teach- 
ing role. For more information, contact the Walt 
Whitman Center for the Culture and Politics of De- 
mocracy, Rutgers, The State University of New Jer- 
sey, Hickman Hall, Douglas Campus, 89 George 
Street, New Brunswick, NJ 08901-1411, (732) 932-6861 . 
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